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Device and method for generating a three-dimensional vascular model 



The invention relates to a device and a method for generating a three- 
dimensional model of a spatial structure, which may be, in particular, a vascular tree. 

Three-dimensional models of a spatial structure are obtained from two- 
dimensional projection images of the structure in many applications, in which connection the 
S reconstruction of a vascular tree is to be considered here to be representative. Such a 

reconstruction is necessary, for example, in the diagnosis of ischemic heart diseases with as 
high a precision as possible in regard to the route and the size of the coronary vessels. In this 
connection, within the framework of the three-dimensional X-ray rotation angiography, an X- 
ray unit is rotated around a patient to be examined while it generates two-dimensional X-ray 
10 projections of the heart from different spatial directions. As a rule, a contrast medium is 

injected into the coronary vessels during the image-taking to display them better on the X-ray 
images. 

Of the X-ray projections produced, however, because of the spontaneous 
movement of the heart as a result of the heartbeat, only those can be used for the 

IS reconstruction of a three-dimensional model of the vessel route that originate from the same 
movement phase of the heart. Typically, a suitable selection of the usable projection images 
is therefore made with the aid of an electrocardiogram recorded in parallel. 

Furthermore, because of the vessel route, which is as a rule very complicated, 
and the limited imaging quality, the required three-dimensional model must currently be 

20 completely reconstructed mzmually. This means that reference points along the route of the 
vessel central lines and also, optionally, other parameters (vessel diameter, bifurcation points, 
etc.) have to be specified on a first selected projection image. The corresponding points or 
sizes are then selected manually on a second projection image, which must originate from a 
similar heartbeat phase, as a result of which the required model is established (cf. T.J. 

25 Keating, P.R. Wolf, F.L. Scarpace, "An improved method of digital image correlation", 

Photogrammetric Eng: Remote Sensing, vol. 41, 993-1002, 1975; C. Smets, P. van deWerf, 
P. Suetens, A. Oosterlinck, "Knowledge-based system for the three-dimensional 
reconstruction of blood vessels from two angiographic projections", Med. Biol. Eng. Comp., 
vol. 29, NS27-36, 1991). 
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Against this background, the object of the present invention was to provide 
means for the simpler and reliable reconstruction of a three-dimensional model of a spatial 
structure, such as, in particular, a vascular tree. 

This object is achieved by a device having the features of claim 1 and also by 
5 a method having the features of claim 10. Advantageous embodiments are contained in the 
dependent claims. 

The device according to the invention serves to generate a three-dimensional 
model of a spatial structure, which may be, in particular, a vascular tree. The device 
comprises the following components: 
10 a) An imaging unit for generating two-dimensional projection images of a 

structure from various directions. Said imaging unit may be, in particular, a rotation X-ray 
unit, such as is used, for example, in computer tomography. 

b) A display imit that is coupled to the imaging unit and has input means, in 
which connection the display unit may display one of the projection images generated by the 

1 5 imaging unit (which is denoted below as a "reference image") for a user so that the user can 
specify interactively at least one image point of the structure on said reference image as a 
reference point. 

c) A data processing device that is coupled to the imaging unit and the display 
unit and may be, in particular, a part of the imaging unit and can also assimie in the latter 

20 tasks of controlling and image processing. The date processing device is designed to 

reconstruct, without interaction of a user, the space point determined belonging to a reference 
point of a structure, using the display unit, from further projection images; in this connection, 
the "further projection images" are those that were produced as the reference image from 
other directions using the image-processing device. The space point determined then 

25 corresponds to the required three-dimensional model or at least a part thereof. 

The device described has the advantage that it makes possible the 
semiautomatic reconstruction of a three-dimensional model of a structure. In this case, unlike 
the known methods, the interactive specification of reference points by a user is only 
necessary on a first reference image. The associated space points of the structure are then 

30 automatically reconstructed by the data-processing device from said reference points with the 
aid of further projection images. Examples of suitable methods or algorithms for the 
automatic reconstruction are explained in the description below, but the invention is not 
restricted to the application of these specific solutions. 
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In accordance with a preferred embodiment, the data-processing device is 
designed to reconstruct the required space point belonging to a specified reference point by 
evaluating those image points of the "further projection images" that are on the respective 
epipolar line of the reference point. In this connection, the **epipolar line of the reference 
S point in regard to a given projection image" is to be understood as that line that lies in said 
projection image and that results if the projection line of the reference point (i.e. the 
connecting line between the reference point and the projection center of the reference image) 
is projected on the given projection image. The epipolar line describes the residual 
xincertainty in regard to the position of a spatial point of which only the reference point is 

10 known as an image in the reference image. The automatic examination of the "further 

projection images" can consequently be restricted to the epipolar lines that are possible solely 
for geometrical reasons, which benefits the reduction of the computation effort. 

In a further aspect of the above-described embodiment, the data-processing 
device is furthermore designed to project the image-point values (i.e. for example, the gray 

IS values) of the image points lying on the epipolar lines of the reference point by computation 
on the projection line of the reference point and to add them therein in a punctiform manner 
to fomi a swn profile. The projection line of the reference point is, as already explained, that 
line that connects the projection center of the reference image to the reference point. The sum 
profile accumulates information items from the various further projection images and 

20 consequently makes possible inferences about the position of the required space point. 

In this connection, the data-processing device may be designed, in particular, 
to define the required space point as that position on the projection line of the reference point 
at which the sum profile assiunes on average (over all the projection images contributing to 
the sum profile) the image-point value of the reference point. If the structure at the required 

25 space point lying on the projection line is such, for example, that said space point yields in all 
its projections roughly the same gray value Xo, said gray value xq is preserved on average in 
the simi profile. Structure parts situated remotely from the projection line of the reference 
point and having a similar gray value xo yield, on the other hand, their contribution to the 
sum profile at different positions on the projection line, with the result that the average values 

30 formed at such positions differ, as a rule, from the value xq. Of particular importzince in this 
connection is the case where the image-point value xo of the reference point has an extreme 
value in regard to the possible image-point values, that is to say, for example, corresponds to 
a maximum absorption on an X-ray image; in this case, the sum profile at the position 
corresponding to the space point likewise assumes an extreme value, i.e. an absolute 
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minimum. This case is of particular practical importance since space points in a structure (for 
example, a biological one) are, as a rule, displayed on different X-ray projection images with 
different absolute gray values, that is to say, do not have approximately the same gray value 
Xo on all images. In contrast, the property of having an extreme gray value (referred to the 
S respective projection) is, as a rule, preserved well in the various projections. 

The spatial structure reconstructed using the device can, in principle, have any 
required shape, for example a spherical shape or the like. In particular, it can have a linear 
route so that, by definition, its extension in the direction of a line (optionally curved and/or 
bifurcated) is greater than in the directions perpendicular thereto. The vascular tree already 

10 mentioned repeatedly is a typical example of a bifurcated linear structure. To reconstruct 
such structures, the data-processing device is preferably designed to reconstruct the linear 
route in a three-dimensional model with the specification of a plurality of reference points on 
a reference image. Typically, a user in this case specifies the route of center lines of the 
structure on a projection image by hand, so that die data-processing device can automatically 

IS reconstruct the remaining spatial route automatically. 

In accordance with a further aspect of the above-described embodiment, the 
data-processing device is designed to determine the width of the linearly extending structure 
from the projection of the reconstructed three-dimensional model of the structure on the 
projection images used for the reconstruction of said model. In this way, the information of 

20 all the projection images is first used to reconstruct the three-dimensional linear route of the 
structure and, in a second step, the result of said reconstruction is then used for determining 
the width in every single projection image. 

The structure imaged is, in many application cases, subject to a cyclic 
spontaneous movement. This is the case, in particular, for a vascular system, which is subject 

25 to the constant action of the heartbeat and the respiration. For such applications, the device 
preferably comprises means for determining a characteristic parameter of the cyclic 
spontaneous movement. In connection with vascular systems, the means may be, in 
particular, an electrocardiography apparatus for recording the electrical heart activity (ECG). 
Furthermore, the data-processing device is in this case designed to use only those projection 

30 images for the reconstruction of a space point that originate from the same phase of the 

spontaneous movement as the reference image belonging to said space point. This ensures 
that the imaged structure has assumed approximately the same spatial position during the 
image-taking operation of the projection images used. 
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It is, however, pointed out that the device does not have to rely on the 
described selection of projection images from ttie same movement phases. On the contrary, it 
is an advantage of the above-explained specific method using the calculation of a sum profile 
that projection images originating from other movement phases may also be used since their 
S possibly geometrically inconsistent contributions are averaged out. An expensive preselection 
of projection images, which requires not least the detemiination of an additional parameter, 
such as, for example, the ECG, can therefore be dispensed with. In this respect, it is 
furthermore advantageous that the information obtained in all the projection images is 
utilized maximally. 

10 The invention relates in addition to a method for generating a three- 

dimensional model of a spatial structure comprising the following steps: 

a) generation of two-dimensional projection images of the structure taken from 
different directions; 

b) display of one of the projection images as a reference image in order to make 

1 S possible the interactive specification of at least one image point of the structure as a reference 
point; 

c) automatic determination of the space point, belonging to the specified image 
point, of the structure from the further projection images generated. 

In general form, the method reflects the steps that can be executed with a 
20 device of the above-described type. For the more detailed explanation of the method, its 
advantages and its variants, reference is therefore made to the above description. 

These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiments described hereinafter. 



25 

In the drawings: 

Fig. 1 shows, in a diagrammatic perspective, the relationships in a two- 
dimensional central projection of a vascular structure G on three projection images A, B, C, 
and also the position of a reference point Ca on a reference image A; 
30 Fig. 2 shows, in a diagram corresponding to Fig, 1, the contributions of a gray- 

value profile from a first projection B; 

Fig. 3 shows, in a diagram corresponding to Fig. 1, the contributions of a gray- 
value profile from a second projection C; 
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Fig. 4 shows the additive superimposition of the contributions in accordance 
with Figs. 2 and 3 to a sum profile S. 



S Fig. 1 shows diagranunatically a three-dimensional vascular tree G, which 

may be, for example, part of the coronary vessels. From the vascular tree G, as accurate as 
possible a model of its three-dimensional route is to be determined, which model is, in 
addition, also to reproduce the respective width of the vessel. 

To reconstnict the required model, two-dimensional projection images A, B, C 

10 of the vascular tree G are generated with the aid of a rotation X-ray unit not shown in greater 
detail, in which connection more than the three projections shown are produced in practice. 
The respective projection centers (that is to say, the positions of the X-ray source) are 
denoted by Fa, Fb and Fc. To achieve an adequate reliability of the model, the interactive 
collaboration of a user is necessary in its reconstruction since the projection images have only 

1 S a limited precision, the structure of a vascular tree is normally very complex and the position 
and shape of the vascular tree changes cyclically from projection image to projection image 
due to the heartbeat. 

The interaction of a user takes place in the method at present considered in 
that the user specifies on a (for example, arbitrarily selected) projection image A, denoted 

20 below as "reference image", points along the route of the center line of the vessels or vessel 
segments of interest. For this purpose, the reference image A may be displayed on a monitor 
so that the user can mark said points with the aid of a pointer appliance, such as, for instance, 
a mouse. In this regard. Fig. 1 shows one of the points marked manually by the user, the so- 
called reference point Ca- 

25 Proceeding from the above-explained scenario, the object to be achieved 

automatically by a device according to the invention consists in finding for the reference 
point Ca specified interactively in the reference image A that associated space point Cao on 
the vascular tree G that is imaged by the reference point Ca. In this connection, the vector 
pointing from the projection center Fa of the reference image A to the reference point Ca, i.e. 

30 the "projection line" of Ca, is denoted below by L, the required space point C3D lying at an 
unknown position on the projection line. The further projection images B, C are used to 
determine said position. 

In this connection, the epipolar lines Ec and Eb, which are defined as the 
projection of the vector L on the respective projection image C or B are considered on the 
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projection images B, C. With the assumption (still to be tested) that the vascular tree G has 
the same spatial position in the generation of all the projection images A, B and C 
considered, the image points belonging to the required space point C3D must lie on said 
epipolar lines Ec, Eb. In a completely manual method, the position of the image point of C^o 
on the epipolar line Ec could, in this connection, be determined on a second projection image, 
for example C, by hand, from which the required spatial position of Cao could then be 
calculated. Such a procedure has, however, the disadvantage that two different projection 
images (A and C) have to be evaluated manually, the correct determination of the 
corresponding point on the second projection image being, as a rule, very difficult. 
Fiirthermore, the information contained in all the other projection images is left out of 
consideration. According to the invention, a method for the automatic location of the space 
point C3D on the vector L is therefore proposed. 

In a first step of said method, the one-dimensional gray-value profile is 
determined along the epipolar line Eb in a first projection image B. Fig. 2 also shows the 
associated route of the profile along the epipolar line Eb both correspondingly scaled and 
projected on the vector L. 

Fig. 3 shows the same procedure for another projection image C and the 
associated epipolar line Ec- The vascular tree G, which is assumed to be opaque to X-rays, 
manifests itself in all the images A, B, C through low gray values, that is to say through 
downward deflections in the gray-value profiles. 

Fig. 4 shows the calculation of a sum profile S that is made up additiveiy from 
the gray-value profiles, projected on the vector L, of the individual projection images B, C 
(Figs. 2, 3). Only the required space point Cbd lying on the vector L has a minimum at the 
same position in all the individual projected gray-value profiles. Minima of vascular branches 
that do not intersect the vector L are, on the other hand, projected in each case at another 
position on the vector L. For these reasons, the location of the required space point €30 is 
emphasized in the sum profile S by constructive superimposition, whereas the contributions 
of other vascular segments are destructively added, that is to say essentially averaged out. 
The position of the gray-value minimum in the sum profile S can consequently be defined as 
the actual spatial position of the required point €30- 

The method described qualitatively above will be formulated more precisely 
mathematically below. In doing so, all the possible spatial positions of the required point C3D 
are described in parameterized form by the following equation: 
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(1) 



where Fa is the radius vector of the projection center of the reference image A and L/|L| is a 
basis vector in the direction of L. The projection, leading to an image point 2Ci = (xi,yi), of any 
space point P on a projection image i that belongs to a given angle a of the C-arm of the X- 
ray unit can be calculated by the projection matrix in accordance with: 



= M 



where Xf = x^ /jCj, yf = I x^ 



(2) 



In addition, let gi(Xi) be the gray value in said projection image i at the 
position Xi> With the aid of this fiinction, a "sum profile*' gray value S(P(A,)) can then be 
assigned to every point P(A.) on L in accordance with the following formula: 



(3) 



In this equation, 2£j is the two-dimensional projected position of P(A,) in a 
certain projection image i that can be determined from equation (2); n is the maximum 
number of projection images involved. 

The projection C, which is substantially at 90^ to the reference image A, is 
imaged with minimimi width on the vector L and therefore determines the boimdaries LI of 
the region on L that is overlapped by the gray-value profiles of all the projections. As Fig. 2 
shows, the projected gray-value profile of every projection B not at 90® is stretched on the 
vector L with respect to the 90*^ projection C. 

In the linear structures, such as the vascular tree G, the minima or valleys in a 
given gray-value profile stand for potential positions at which a vessel may be situated in 
space. In the sum profile S, said minima add constructively only at the required space point 
C3Df whereas the superimposition is destructive for the other "candidates" and result in an 
averaging out (an exception occurs if the vascular tree G intersects the vector L more than 
once; in this special case, the simi profile S accordingly has many minima). 

The projection images A, B, C used for the reconstruction may optionally be 
selected by means of a parallel recording of the electrocardiogram in such a way that they all 
belong to the same phase of the heart cycle. Of special advantage in the method described, 
however, is the fact that such a preselection is not absolutely necessary since the 
contributions of the projection images from unsuitable heart phases average out. The method 



wo 2005/020155 



PCT/IB2004/051428 



9 

can therefore be made simpler by dispensing with a selection and the information from all the 
projection images can be used simultaneously. 

In addition, the method described also makes it possible to determine the 
width of the vessels of the vascular tree G. A measure of this may, for example, be obtained 

S from the width of the minimum in the sum profile S. Advantageously, however, a three- 
dimensional vascular tree once reconstructed is projected on all the available projection 
images A, B, C in order to display the center lines of the vessels therein. The respective 
vessel width can then be determined punctifomily along the vessel route in each of the 
projection images by evaluating, for example, the gray-value distributions transversely to the 

1 0 projected vessel route. 

For the description of experimental examples, reference is made to the 
publication entitled "Single Projection Modeling" by B. Movassaghi, V. Rasche, M. A. 
Viergever and W. J. Niessen (Medical Image Computing and Computer Assisted 
Interventions - MICCAI-Conference 2003), which is incorporated by reference in its full 

IS scope in the present application. 



